'DC  FILE  COPY 


Tecbiical  Pap«r  287 


AD 


A COMPUTER  GRAPHIC-BASED  AID  FOR  ANALYZING 
TACTICAL  SIGHTINGS  OF  ENEMY  FORCES 

Franklin  L.  Moses  and  Richard  P.  Vande  Hei 


BATTLEFIELD  INFORMATION  SYSTEMS  TECHNICAL  AREA 


U U 

W FEB  7 1978 

A 

'jnJ  u btL 

A 


U.  S.  Army 

Research  Institute  for  the  Behavioral  and  Social  Sciences 


January  1978 


Approved  for  public  release,  disirtbution  unlimited. 


U.  S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


W.  C.  MAUS 

J.  E.  UHLANER  COL,  GS 

Technical  Director  Commander 


NOTICES 


DISTRIBUTION:  Primary  distribution  of  this  report  hat  been  made  by  ARI.  Please  address  correspondence 
concerning  distribution  of  reports  to;  U.  S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences, 
ATTN:  PERI-P,  5001  Eisenhowe'  Avenue,  Alexandria,  Virginia  22333. 


FINAL  DISPOSITION:  This  report  inay  be  destroyed  when  it  it  no  longer  needed.  Please  do  not  return  it  to 
the  U.  S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences. 


MCFEi  The  findings  in  this  report  are  not  to  be  construed  at  an  official  Department  of  the  Army  position, 
unless  to  datignatad  by  other  authorized  documents. 


w 


Unclassified 

SECURITY  CLASSII'ICATION  OF  THIS  PAGE  (Trhsn  Dmim  EnlTmd) 


6 


!< 


REPORT  DOCUMENTATION  PAGE 


1.  REPORT  NUMBER^  ] 

Technical  /ape r '267 


12.  GOVT  Acce&6iQiLJia 


4.  TITLE  (tmd  Subtittm) 


A COMPUTER  ^RAPHIC-BASED  AID  FOR ^NALYZ ING  / 
TACTICAL  SIGHTIKGS  OF  ENEMY  FORCES  i — 

r * m ‘ 


7.  AUTHOn(4^.  . 

> Franklin  L^Moses  Richard  P./Vande  Hei 


>.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

U.S.  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences,  5IOO  Eisenhower  Avenue,  ^ 
Alexandria,  VA  22553 


M.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 


U.S.  Army  Combat  Arms  Development  Agency 
U.S.  Army  Intelligence  Center  and  School 


14.  MONITORING  AGENCY  NAME  A ADORESSf/^  rfl//«Mnt  Iraqi  Cantntllnd  OUIe0j 


if;.  ' 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.  p^qiPlFMT*^  TATAl  NUMBER 


5.  TYPE  OF  REPORT  4 PERIOD  COVERED 


6.  PERFORMING  ORG.  REPORT  NUMBER 


a.  CONTRACT  OR  GRANT  NUMBERr*) 


to.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  a WORK  UNIT  NUMBERS 


2Q762722A765  / 


t2.  REPORT  DATE 

p/Jjan! 


19.  NUMBER  OF  PAGES 

25 


1 


15.  SECURITY  CLASS,  (ot  Otim  rmport) 

Unclassified 


ISm.  declassification/ down  GRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  ^ef  (hi*  Report) 


Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (oi  tft0  mbstrmet  mffr0d  in  Block  30,  II  diflormt  froot  Roport) 


16.  SUPPLEMENTARY  NOTES 


19.  KEY  WORDS  (Continum  on  towortm  oldm  11  nocoooory  and  tdanttly  by  block  number) 


man/computer  Interaction 
Information  processing 
decision  aids 

Tactical  Operations  System  (TOS) 


military  Intelligence 
graphics 
data  displays 
battlefield  patterns 


cluster  analysis 
movement  analysis 
graphic  display 
applications 


20!  A^g^ACT  frwrwm  t,  nmnmmstr  lOmntltr  *7  block  niMibf) 

Computer  and  computer-driven  graphics  are  being  explored  for  potential 
utilization  by  the  battlefield  staff.  One  such  effort  is  designed  to  assist 
detecting  patterns  by  replacing  manual  plots  of  sightings  with  efficient  and 
flexible  computer  graphic  techniques  and  associated  algorithms.  An  inter- 
action of  the  analyst  with  these  displays  and  algorithms  for  analyzing 
sightings  forms  the  basis  for  the  present  evaluation  of  a battlefield 
Interpretation  aid. 


in 


DD  , 


FOfM 
JAM  73 


1473 


EDITIOH  OF  « NOV  SS  IS  OKOLETE 


Unclassified 


SECUMITY  CLASSIFICATION  OF  THIS  PACE  (Wkmt  Dmtm  Enimd) 


/o  9 


if  led 


SeCURITV  CLASSIFICATION  OF  THIS  FAOEfWhan  Data  Bnlmnd) 


Unclassified 

SeCONITV  CLASSIFICATION  OF  THIS  PAGEfWhan  Oala  Enlararf) 


■iSEmr. 


Tacbiicol  Popar  287 


A COMPUTER  GRAPHIC-BASED  AID  FOR  ANALYZING 
TACTICAL  SIGHTINGS  OF  ENEMY  FORCES 


Franklin  L.  Moses  and  Richard  P.  Vande  Hei 


Raymond  C.  Sidorsky 
Work  Unit  Leader 


BATTLEFIELD  INFORMATION  SYSTEMS  TECHNICAL  AREA 
Robert  S.  Andrews 


Submitted  by: 

Joseph  Zeidner,  Director 
ORGANIZATIONS  AND  SYSTEMS 
RESEARCH  LABORATORY 


Approved  By: 

J.  E.  Uhlaner 
TECHNICAL  DIRECTOR 


U.S.  ARMY  RESEARCH  INSTITUTE  FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 
5001  Eisenhower  Avenue,  Alexandria,  Virginia  22333 

Office,  Deputy  Chief  of  Staff  for  Personnel 
Department  of  the  Army 


January  1978 


Army  Project  Number 
2Q762722A766 


Tactical  Operations  and  Displays 


Approved  for  puHie  telNia;  dlitrlbution  unlimited. 


r 


IARI  Research  Reports  and  Technical  Papers  are  intended  for  sponsors  of 

R&D  tasks  and  other  research  and  military  agencies.  Any  findings  ready  for 
implementation  at  the  time  of  publication  are  presented  in  the  latter  part  of 
the  Brief.  Upon  completion  of  a major  phase  of  the  task,  formal  recommen 
dations  for  official  action  normally  are  conveyed  to  appropriate  military 
! agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


The  Battlefield  Information  Systems  Technical  Area  of  the  U.S. 
Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI)  is  concerned  with  the  application  of  Behavioral  Science 
principles  and  techniques  to  the  solution  of  problems  involving 
information  processing,  decisionmaking,  and  operator/user  perform- 
ance in  military  information  systems  and  contexts. 


One  major  objective  is  to  determine  basic  capabilities  and 
limitations  of  man  as  an  information  processor  and  to  devise 
complementary  and  compensating  processing  aids  and  techniques. 
Some  functions  are  best  accomplished  by  man,  some  by  computer, 
and  some  by  an  interactive  relationship  between  man  and  computer. 
ARI  Technical  Paper  258,  "Computer-Based  Displays  as  Aids  in 
the  Production  of  Tactical  Intelligence,"  illustrated  basic 
graphic  display  concepts  with  a set  of  situation  maps  derived  from 
a large  tactical  exercise  scenario.  The  present  publication 
extends  these  concepts  and  evaluates  an  interactive  graphic  aid 
designed  to  assist  staff  analysts  in  analyzing  and  understanding 
patterns  of  enemy  activity.  The  effort  represents  one  phase  in 
the  exploration  of  concepts  for  automated  aids  to  assist  analysts 
and  decisionmakers  in  understanding  enemy  intentions  and  capabil- 
ities and  provides  part  of  the  necessary  technological  base  for 
research  leading  to  applications  recommendations. 

Research  in  the  area  of  staff  aids  for  tactical  data  systems 
is  conducted  as  an  in-house  effort.  The  entire  effort  is  respon- 
sive to  requirements  of  Army  Project  2Q762722A765  and  to  special 
requirements  of  the  U.S.  Army  Combat  Arms  Combat  Development 
Activity  (CACDA),  Fort  Leavenworth,  KS,  and  the  U.S.  Army  Intelli- 
gence Center  and  School,  Fort  Huachuca,  AZ.  CACDA  special  require- 
ments include  Human  Resource  Needs  76-163  (Automated  Display 
Requirements  and  Procedures  for  Mass  and  Movement  Analysis)  and 
76-165  (ADP  Methods  for  Utilization  of  Analytic  Aids  and  Logic 
Models  in  Intelligence  Processing). 
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BRIEF 


Requirement : 

To  evaluate  a computer  calculation  procedure  coupled  with 
automated  graphics  to  assist  in  understanding  movement  and  patterns 
of  enemy  activity. 


Procedure: 

Questions  were  asked  about  direction,  speed  of  movement  and 
changes  in  location  of  battlefield  activity  in  a classical  division 
attack  scenario.  In  one  research  condition,  answers  were  derived 
by  six  "aided"  participants  who  specified  sightings  on  a graphic 
display  from  which  the  computer  calculated  distances,  speeds, 
etc.  In  the  second  condition,  six  "unaided"  participants  derived 
answers  from  the  displays  without  the  use  of  computerized  calcu- 
lations. Answers  and  time  needed  for  solutions  were  recorded. 
Accuracy  of  responses  was  calculated. 


Findings : 

Responses  from  participants  in  the  aided  condition  were 
substantially  more  accurate  than  responses  from  participants  in 
the  unaided  condition.  However,  measures  of  time  did  not  meaning- 
fully discriminate  between  the  aided  and  unaided  performance. 


Utilization  of  Findings: 

Results  suggest  that  analyst-controlled  computerized  algorithms 
should  be  used  for  determining  consistent  enemy  patterns  from 
computer  graphic  displays  of  sightings.  The  laboratory  research 
forms  the  basis  for  concluding  that  such  pattern  analysis  algo- 
rithms linked  with  graphics  are  preferable  to  either  processes 
using  computerized  graphics  alone  or  manual  techniques  involving 
grease-pencil  drawings  of  sightings.  Further  development  of 
graphic-based  aids  for  mass/movement  and  related  temporal/spatial 
analyses  of  enemy  forces  is  necessary.  However,  present  data  are 
sufficiently  promising  to  justify  some  provision  for  such  aids  in 
requirements  documents. 
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A COMPUTER  GRAPHIC-BASED  AID  FOR  ANALYZING  TACTICAL  SIGHTINGS  OF  ENEMY 
FORCES 


INTRODUCTION 

Computer  graphics  can  aid  in  simplifying  the  recognition  of  patterns 
of  spatially  and  temporally  distributed  events.  Graphic  displays  could 
be  used  in  reducing  time  and  effort  in  detecting  patterns  of  tactical 
I battlefield  activity.  For  example,  consider  how  computer  graphics  could 

assist  the  Intelligence  analyst  In  detecting  a shift  of  battlefield 
emphasis  over  a 24-hour  period.  The  current  manual  procedure  requires 
i time-consuming  grease-pencil  plots  of  symbols  on  numerous  map  overlays 

representing  time  slices  of  reported  activity.  These  plots  of  related 
Information  are  examined  to  determine  whether  there  are  consistent 
^ patterns.  In  contrast  to  the  slow  and  tedious  manual  plots,  computer 

I graphics  could  rapidly  generate  time  slices  of  related  information 

i'  required  for  detecting  patterns  of  activity.  The  current  manual  proce- 

dure also  uses  the  Information  In  plots  of  activity  for  calculating  time 
and  distance  relationships  that  describe  patterns  of  movements.  With 
f computer  graphics,  the  intelligence  analyst  could  specify  on  displays 

■ the  activity  which  he  wants  included  in  computerized  tlme/dlstance 

f calculations.  The  present  research  was  designed  to  evaluate  a computer 

[ graphics/calculation  approach  as  applied  to  the  military  situation. 

I 

t 

j There  is  no  clearly  defined  technique  agreed  upon  for  determining 

I patterns.  However,  the  intelligence  analyst's  manual  procedures  provide 

! guidelines  and  clues  for  operationally  defining  what  he  does  to  detect 

patterns.  Introspectlvely , the  analyst  Indicates  that  he  chooses 
clusters  of  seemingly  related  activities  over  time  and  then  does  a set 
of  rough  approximations  of  their  "centers  of  mass."  However,  this 
determination  of  related  clusters  is  only  part  of  identifying  patterns. 
There  always  is  some  "random"  movement  in  battlefield  activity.  An 
analyst  can  be  misled  by  cluster  relationships  which  are  not  substanti- 
ated by  reasonable  time  and  distance  measures  such  as  average  speed 
of  travel,  average  projected  time  of  arrival  at  specific  places,  or 
possible/probable  destinations. 

Given  a computer-based  display  of  sightings,  the  analyst  could  expend 
less  effort  on  clerical  tasks.  In  addition,  the  computer  could  help  him 
with  tlme/dlstance  calculations  for  comparing  sightings.  The  analyst 
could  concentrate  on  looking  for  time/distance  related  trends  such  as 
I pre-posltlonlng  of  logistics,  lead  armor  activity,  positioning  of  artll- 

( lery,  and  other  evidence  of  shifts  in  enemy  operational  intent.  In 

I summary,  methods  which  use  computerized  graphics  for  determining  patterns 

and  resultant  trends  would  help  the  military  analyst  to  weigh  events 
differentially.* 


' Bowen,  R.  J.,  Feehrer,  C.  E. , Nickerson,  R.  S.,  and  Triggs,  T.  J. 
Computer-based  displays  as  aids  in  the  production  of  Army  tactical 
intelligence.  Army  Research  Institute,  Technical  Paper  258,  February 
1975. 


The  present  research  required  that  Intelligence  analysts  use  time/ 
distance  measures  to  summarize  possible  relationships  of  clusters  which 
they  identified  on  graphic  displays  of  battlefield  events.  The  research 
assessed  whether  the  analyst's  information-processing  burden  would  be 
reduced  by  computerized  algorithms  which  calculate  geometrical  centers  of 
activity  clusters  and  their  time/distance  relationships.  Some  analysts 
were  provided  with  this  graphics/calculation  aid  and  others  were  not. 

The  immediate  objective  was  to  evaluate  an  interactive  graphic  aid 
(GRAID),  identify  its  weaknesses,  and  determine  its  potential.  Com- 
puterized displays  were  used  to  present  activity  symbols  in  both  the 
unaided  (i.e.,  manual)  and  aided  conditions.  The  comparison  required 
the  unaided  group  to  summarize  movement  characteristics  of  patterns 
without  computer  calculations;  the  aided  group  could  request  computer 
calculations  and  graphic  displays  of  centers  of  clusters  and  their  time/ 
distance  relationships.  The  research  hypothesis  was  that  an  interactive 
graphic  aid  for  calculations  (aided  condition)  relevant  to  pattern 
analysis  would  allow  analysts  to  draw  inferences  more  quickly  and  more 
effectively  than  would  be  possible  with  graphic  displays  alone  (unaided 
condition) . 


METHOD 


PARTICIPANTS 

The  seventeen  participants  were  Army  officers  (Captains  & Majors) 
from  the  intelligence  community  who  had  varying  degrees  of  familiarity 
with  prescribed  military  procedures  for  abstracting  patterns  of  battle- 
field activity.  Eight  participants  were  randomly  assigned  to  the  aided 
research  condition  and  nine  participants  to  the  unaided.  Six  partici- 
pants in  each  condition  completed  the  tasks  satisfactorily,  and  their 
performance  provided  the  basis  for  the  statistical  analysis. 


TASK 


Participants  were  presented  with  a series  of  questions  (Appendix  A) 
aimed  at  characterizing  components  of  the  complex  pattern  analysis 
process.  The  questions  asked  about  predicted  locations,  change  of 
directions,  and  speeds.  There  were  20  Individual  and  multipart  questions 
in  the  context  of  a scenario  of  battlefield  events  in  a hypothetical 
situation. 

The  scenario  Involved  a classical  Soviet  motorized  rifle  division 
attacking  on  a narrow  front  (13KMS)  for  a 36-hour  period.  The  attack 
scenario  focused  on  a two-axis  (two-regiment)  thrust  attacking  out  of 
training  cover  and  deception  maneuvers.  This  training  included  an 
entire  Soviet  division  on  Soviet-controlled  territory.  During  these 


2 


r 


division  maneuvers,  one  regiment  made  a major  thrust  in  the  north  into 
friendly  controlled  territory.  This  regimental  thrust  was  an  extension 
of  the  cover  and  deception  plan  intended  to  force  the  friendly  commander 
to  emphasize  Importance  of  the  battlefield  to  the  north  while  rendering 
the  southern  sector  vulnerable  to  the  actual  Soviet  attack  (one  regiment 
on  line  and  one  regiment  following  with  an  eventual  exploitation  mission). 

The  scenario  Incorporates  realistic  logistical/tactical  time  phasing 
and  use  of  terrain.  It  culminates  with  the  preparation  for  a deliberate 
river-crossing  exercise  complete  with  realistic  assembly  area  selection 
and  accompanying  fire  support/loglstlcal  activities. 


COMPUTERIZED  AID 

The  aid  involved  two  user-selected  clusters  of  sightings  that 
could  be  compared  for  average  space  and  time  differences.  With  the 
sightings  overlayed  on  a map,  each  cluster  could  be  delimited  by  enclo- 
sures containing  sightings  from  a two-hour  time  period  or  some  multiple 
of  this  length.  The  computer  calculated  two  centers  of  unweighted  mass 
(l.e.,  two  "central"  points)  based  on  the  geometrical  relationship  6f 
sightings  within  each  enclosure.  A calculation  was  then  done  to  deter- 
mine: (1)  the  vector  distance  between  the  centers  and  (2)  the  time 

between  the  half-way  points  of  the  time  intervals  from  which  clusters 
were  selected.  The  display  of  sightings  showed  centers  of  mass  desig- 
nated by  "Xs"  and  distances  between  them  be  vectors.  In  addition, 
time  and  distance  figures  were  printed  on  the  display. 

APPARATUS 

The  principal  apparatus  for  participants  was  two  19"  color  television 
displays  (Conrac,  Inc.),  ^ a typewriter-like  keyboard  and  a displayed 
cursor/  pointer  connected  to  a trackball.  This  apparatus  was  interfaced 
with  a computer-based  graphic  system  (Anagraph,  Amcomp,  Inc).  The 
keyboard  and  trackball  were  used  by  participants  to  "talk"  to  the 
system.  The  computer  generated  all  alphanumeric  and  graphic  information 
for  the  displays  except  for  a map  background  representing  a 12  x 16 
kilometer  area.  This  map  image  was  transmitted  to  the  computer  by  a 
color-television  camera  (GBC  CTC  3XP)  and  could  be  combined  with  the 
computer-generated  images  before  display.  The  research  station  also 
provided  the  participant  with  a booklet  concerning  details  of  scenario 
sightings  (Appendix  B) , a hardcopy  map  of  the  relevant  area,  grease 
pencils,  and  a participant-experimenter  intercom.  The  experimenter  had 
television  monitors  linked  to  the  participants'  displays. 


^ All  commercial  designations  and  trademarks  are  used  only  for  precision 
in  describing  the  experiment.  Their  use  does  not  constitute  endorse- 
ment by  the  Army  or  by  ARI. 
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PROCEDURE 


Each  participant  sat  three  feet  in  front  of  the  displays  and  was  j 

told  that  the  experimenter  could  monitor  these  images.  The  left-hand  j 

display  showed  the  map  for  the  scenario  and  could  also  show  any  symbols 
representing  scenario  sightings.  Sightings  were  represented  by  rectan-  | 

gles,  triangles,  and  asterisks  labeled  with  a letter-number  identifier.  j 

The  symbols  corresponded  to  three  broad  classes  of  sighting  types  (armor; 
artillery;  wheeled  vehicles  and  bridging  equipment),  and  the  letter- 
number  pairs  corresponded  to  Information  in  a booklet  correlated  with 
symbols  on  the  display.  Only  one  sighting  type  could  be  displayed  at  a 
time. 

The  right-hand  display  Initially  presented  computer-assisted  instruc- 
tions. These  began  by  telling  participants  that  one  of  several  possible 
approaches  to  pattern  analysis  was  being  evaluated.  Their  task  was  to 
use  pattern  analysis  for  answering  specific  questions  about  a battlefield 
scenario.  Pattern  analysis  was  defined  and  examples  given.  As  part  of 
the  instructions,  the  right-hand  display  also  explained  the  keyboard 
typing  formats  required  for  requesting  displays  of  sightings  or  answering 
questions.  During  the  actual  task,  the  same  display  became  the  source  of 
pattern  analysis  questions  and  prompting  messages  for  formats.  VAiatever 
participants  typed  appeared  on  this  screen,  and  the  computer  could  dis- 
play messages  concerning  any  format  errors.  Instructions  and  prompting 
messages  were  displayed  in  green,  questions  and  participant-generated 
requests  and  answers  were  in  vdilte,  and  error  messages  appeared  in  red. 

Instructions  required  participants  to  practice  using  the  keyboard  for 
displaying  sightings  and  for  answering  procedural  questions.  They 
displayed  a sample  two-hour  activity  slice  and  a combination  of  several 
contiguous  two-hour  slices  which  appeared  in  red.  By  requesting  a pair 
of  two-hour  or  greater  time  intervals,  participants  saw  that  red  symbols 
in  one  Interval  contrasted  with  green  symbols  in  the  second  interval. 

During  the  Instruction  phase,  questions  about  procedures  for  using  the 
system  were  presented  to  both  the  aided  and  unaided  participants. 

Participants  in  both  the  aided  and  unaided  conditions  learned  how  to 
use  the  computerized  displays  for  viewing  sightings.  In  addition,  each 
participant  in  the  aided  task  learned  to  control  the  trackball  and  its 
cursor.  They  were  told  how  the  cursor  could  be  used  to  specify  sightings 
for  center  of  mass  and  tlme/dlstance  calculations  as  an  aid  to  analyzing  ] 

patterns.  After  seeing  an  example,  they  practiced  using  the  cursor  to 
mark  corners  of  enclosures  around  sightings  and  to  correct  the  marks. 

The  last  part  of  the  practice  for  aided  participants  required  them  to 
follow  a simple  pattern  analysis  procedure.  They  had  to  try  each  sample 
procedure  and  reply  to  each  question  in  the  instructions  before  the 
computer  allowed  the  session  to  continue. 

i 
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All  participants  were  Instructed  to  stress  accuracy  in  their 
performance  but  to  work  at  a smooth  pace*  In  the  unaided  research 
condition,  the  participants  used  mental  judgments  and  calculations  to 
answer  questions*  In  contrast,  aided  participants  were  required  to  take 
full  advantage  of  the  computerized  aid  for  analyzing  pairs  of  sighting 
clusters*  Each  participant  was  asked  to  answer  questions  at  face  value 
and  not  to  overinterpret  the  task*  The  rate  at  which  Instructions  and 
the  research  task  proceeded  was  paced  by  the  individual*  The  instruc- 
tions took  about  three  hours  and  each  task  about  five  hours*  Any  prob- 
lems which  arose  could  be  discussed  via  the  participant-experimenter 
Intercom*  After  the  research  session,  each  participant  discussed  the 
research  and  answered  a written  questionnaire  (Appendix  C)  as  part  of 
a debriefing* 


EXPERIMENTAL  DESIGN 

The  design  consisted  of  a two-way  analysis  of  variance  in  which  the 
Independent  variables  were  conditions  (aided  vs*  unaided)  and  questions 
(16  items)*  Conditions  was  a between-subjects  factor  (six  subjects 
per  condition),  and  questions  a within-subjects  factor*  The  analysis 
for  this  design  is  given  in  Table  1 * 


Table  1 

ANALYSIS  OF  THE  ACCURACY  OF  ANSWERS  TO  QUESTIONS 


Source  of  Variation 

Degrees 
of  Freedom 

Mean 

Square 

F-ratio 

Between  Subjects 

Aided  vs*  Unaided  Conditions  (C) 

1 

34*60 

46*1* 

Subjects  within  Groups 

10 

*75 

Within  Subjects 

Questions  (Q) 

15 

2*48 

2*7 

QxC 

15 

1*30 

1*4 

Error 

150 

*93 

*p  < *001 


RESULTS 

Dependent  measures  were  (1)  time  required  to  answer  each  question 
and  (2)  accuracy  of  answers*  Correct  answer  criteria  were  based  on 
standard  military  doctrine*  Each  participant's  answers  to  questions 
were  converted  to  accuracy  data  by  taking  absolute  deviations  from  the 
correct  answers*  These  data  were  rounded  to  the  nearest  *5  km  because  of 
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variations  in  the  overlay  of  plots  of  activity  in  relation  to  the  map 
background.  A total  of  16  answers  were  Included  in  the  analysis  as  a 
result  of  subtracting  four  practice  questions  and  eliminating  questions 
7 and  8 because  observations  and  Interviews  with  participants  showed 
that  the  two  questions  had  no  consistent  Interpretation.  Responses  to 
questions  In  the  aided  condition  were  significantly  (p  < .001)  more 
accurate  than  responses  In  the  unaided  condition.  A summary  of  the 
accuracy  data  shows  the  magnitude  of  errors  (Table  2). 

The  time  spent  on  questions  In  the  aided  and  unaided  conditions 
varied  greatly,  and  no  significant  differences  were  found  In  the  ANOVA. 
An  attempt  to  reduce  this  variability  was  made  by  using  a log  transform 
of  time  spent  on  each  question.  An  ANOVA  on  the  log  data  also  showed  no 
significant  differences  between  research  conditions  and  no  significant 
condition/question  Interaction  effect.  Therefore,  neither  raw  time  nor 
log  time  for  doing  questions  could  meaningfully  discriminate  between 
the  two  performance  conditions. 


DISCUSSION 

The  analysts  who  organized  graphic  displays  of  battlefield  activity 
Into  patterns  with  the  aid  of  computerized  calculations  were  more  accu- 
rate than  analysts  who  used  only  graphic  displays.  However,  aided 
analysts  needed  the  same  amount  of  time  for  the  tasks  as  analysts  who 
relied  on  their  personal  estimates  for  relating  changing  activity. 

Speed  of  performance  may  have  been  confounded  with  characteristics  of 
the  particular  computer  graphic  system  as  well  as  with  related  thought 
processes  demanded  by  the  tasks. 

In  debriefing  statements,  participants  supported  the  use  of  comput- 
erized graphic  displays  of  activity  as  a basis  for  doing  pattern  analysis 
either  with  or  without  a computer  calculation  aid.  Participants  said 
that  graphics  made  It  possible  to  see  various  spatial  comparisons  quickly 
and  to  use  color  for  distinguishing  sightings  during  one  time  period 
from  sightings  at  a different  time.  Studying  several  configurations  of 
graphic  Information  was  one  way  of  helping  patterns  to  emerge.  Although 
many  participants  had  limited  experience  with  computerized  systems,  they 
generally  favored  automated  displays  and  their  data  favored  the  value  of 
the  aided  condition. 
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ACTUAL  ANSWERS  TO  QUESTIONS  AND  THE  ABSOLUTE  MAGNITUDE 
OF  RESPONSE  ERRORS  (IN  KM)  ACROSS  SUBJECTS 


Question 

Answer^ 

Mean  Error 

Aided  Unaided 

Variance 

Aided  Unaided 

5 

5.5 

0.0 

.8 

0.0 

.5 

6 

10.8 

.3 

1.6 

. 1 

1.  1 

9 

5.5 

.2 

1.2 

.1 

.2 

10 

1.6 

.5 

1.3 

.8 

.5 

11 

map  coordinate^ 

0.0 

1.8 

0.0 

6.6 

11a 

map  coordinate^ 

0.0 

.9 

0.0 

.5 

12 

9.0 

1.0 

2.5 

1.6 

1.9 

13 

2.4 

.2 

.5 

. 1 

0.0 

14 

map  coordinate^ 

1.6 

1.0 

.8 

.5 

14a 

map  coordinate^ 

.3 

.3 

.1 

. 1 

15 

1.5 

. 1 

1.6 

0.0 

. 7 

16 

2.6 

0.0 

.9 

0.0 

.5 

17 

1.9 

0.0 

.4 

0.0 

. 1 

18 

6.6 

.4 

2.2 

.9 

5.9 

19 

6.4 

1.2 

1.5 

.6 

.3 

20 

CM 

• 

CM 

0.0 

.9 

0.0 

.2 

X 

= .56  X 

= 1.21 

a 

For 

computational  purposes 

f answers 

were  converted 

to  distance 

measures 

(in  km)  where  necessary. 

Answers  required  the  location  of  activity  as  opposed  to  time-distance 
differences. 
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PARTICIPANT  QUALIFICATIONS 


The  participants  varied  In  their  ability  to  perform  the  pattern 
analysis  tasks.  Despite  claims  of  one  or  more  years'  experience  with 
pattern  analysis,  five  persons  (three  aided  and  two  unaided)  of  the 
original  17  had  enough  difficulty  with  the  tasks  to  justify  eliminating 
their  data.  These  five,  far  more  than  any  of  the  other  participants, 
showed  a lack  of  attention  to  detail  which  resulted  In  a tendency  toward 
global  analyses.  A related  problem  was  a tendency  to  emphasize  sighting 
types  and  locations  with  too  little  concern  for  directions  of  movement 
and  the  times  at  which  events  occurred.  Some  of  the  five  eliminated 
participants  also  disregarded  Instructions  to  be  discriminating  and 
used  many  extraneous  sightings  In  problem  solutions.  In  general, 
accuracy  In  performance  appeared  to  be  worse  when  hunches  and  Interpre- 
tations overshadowed  careful  consideration  of  factual  information. 


ACCURACY  DATA 

With  the  computer-aided  calculations,  time-distance  comparisons  were 
significantly  more  accurate  than  those  comparisons  made  without  aid. 

The  meaningfulness  of  the  difference  in  accuracy  may  be  evaluated  In 
terms  of  the  proportion  of  error  In  relation  to  the  magnitude  of  correct 
answers.  For  example,  if  a correct  answer  Is  100  kilometers,  then  a 1-km 
error  (proportionally  1%)  probably  Is  not  Important.  In  contrast,  if  the 
correct  answer  is  5 km,  a 1-km  error  (proportionally  20%)  Is  likely  to 
be  important.  Such  criteria  applied  to  the  current  research  results 
indicate  a meaningful  difference  between  the  aided  condition  and  the 
graphics-alone  (unaided)  condition.  Mean  proportional  errors  for  each 
question  averaged  across  unaided  participants  ranged  from  .15  to  1.1; 
mean  errors  for  the  aided  group  ranged  for  0 to  .3.  Imagine  such  errors 
In  the  context  of  trying  to  estimate  the  arrival  time  of  troops  at  a 
particular  location,  the  distance  between  two  artillery  targets,  and 
other  such  problems.  The  aid  obviously  did  not  eliminate  error,  but 
it  did  lead  to  generally  smaller  errors  and  more  consistency  than  use 
of  graphics  alone. 


TIME  DATA 

Reducing  the  time  needed  to  perform  pattern  analysis  was  an  Important 
consideration  In  designing  a computerized  aid.  For  the  plotting  of 
sightings,  computer  graphics  naturally  is  faster  than  manual  methods 
which  require  grease  pencils  and  acetate  overlays.  However,  one  may 
wonder  why  the  application  of  computer  calculations  to  the  graphic 
displays  did  not  reduce  the  time  needed  for  answering  questions.  The 
Importance  of  automated  displays  for  sightings  should  not  be  overlooked, 
but  the  aid  is  not  optimal  until  the  time  for  deriving  patterns  is 
reduced . 
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The  research  procedures  are  a source  of  suggestions  about  how 
to  reduce  time  for  using  the  aid.  In  the  research,  familiarity  with 
the  apparatus  and  practice  time  were  limited.  If  any  aid  were  to  be 
Implemented,  analysts  should  be  given  time  to  thoroughly  learn  the 
system  so  that  speed  in  its  use  can  be  stressed  without  accuracy  losses. 
In  addition  to  practice,  time  for  pattern  analysis  might  be  reduced  by 
using  computer  algorithms  which  show  the  analyst  examples  of  patterns 
that  are  tactically  relevant  to  a situation.  Kahneman^  has  suggested 
that  the  performance  of  any  specific  activity  is  associated  with  the 
allocation  of  a certain  amount  of  effort;  allocating  less  effort  is 
possible,  but  the  allocation  of  more  effort  may  seem  beyond  an  individ- 
ual's ability.  Therefore,  the  analyst's  ability  may  have  to  be  extended 
with  adaptive  computer  routines.  Perhaps  the  computer  could  "learn" 
from  prior  pattern  analysis  which  analysts  have  done  and  then  make 
suggestions  that  reduce  the  time  needed  for  specific  future  evaluations. 
Further  work  is  needed  before  any  conclusions  can  be  made  about  how  to 
optimize  the  time  requirements  of  the  aid. 


IMPROVING  THE  AID 

Graphics  used  in  support  of  the  calculation  aid  might  be  Improved 
by  more  descriptive  symbols  and  by  allowing  more  flexible  requests  for 
displaying  battlefield  events.  For  example,  the  symbols  might  actually 
represent  different  vehicle  types  (e.g.,  truck  or  jeep).  Displays  also 
might  contain  individual  direction  vectors  to  help  in  analyzing 
Information.  Requests  for  displays  of  sightings  should  not  be  limited 
to  broad  groupings  (e.g.,  armor;  artillery;  wheeled  vehicles)  of 
information  types.  IVo  possibilities  suggested  by  participants  were  the 
capability  to  request  a specific  sighting  type  (e.g.,  tanks  in  contrast 
to  the  more  general  category  of  armor)  and  the  capability  to  specify  a 
mix  of  several  types  of  sightings  at  one  time  (e.g.,  trucks  and  tanks). 
Of  course,  such  display  changes  have  implications  for  use  of  color, 
shapes,  and  other  codes  for  differentiating  sightings  from  one  another. 

The  tested  algorithm  for  the  aid  could  be  improved  by  making  speed 
and  distance  estimates  more  realistic.  For  example,  average  speeds  for 
different  classes  of  data  (e.g.,  jeep  vs.  tank)  could  be  Included  in  the 
calculations  relating  one  cluster  of  activity  to  another.  In  addition, 
weather  and  terrain  conditions  might  change  estimates  of  movement  times 
and  speeds.  Graphic  displays  of  the  effect  of  changing  conditions  on 
movements  should  be  far  more  quickly  and  easily  assimilated  than  the 
presentation  of  such  Information  in  hardcopy  or  in  alpha-numeric  form. 


3 


Kahneman , D 
Hall,  1973. 


Attention  and-  effort.  Englewood  Cliffs,  NJ:  Prentice- 


r 1 


A more  sophisticated  aid  also  would  have  additions  to  Its  basic 
center  of  mass  calculations.  The  use  of  a geometrical  center  for 

equally  weighted  data  elements  made  the  calculations  easy  to  Implement,  j 

but  answers  based  on  such  calculations  are  a limited  reflection  of  real 
world  conditions.  For  example.  If  one  were  analyzing  armor  patterns,  j 

then  tanks  might  be  Included  with  armored  personnel  carriers  In  the 
computer's  calculation  of  a center  of  mass.  However,  an  equal  weighting 
of  these  elements  would  not  represent  a completely  accurate  summary  of 
the  information  If  one  were  Interested  In  combat  power.  Either  the 
computer  should  contain  weights  according  to  potential  combat  power 
contributions  or  an  analyst  should  be  allowed  to  Influence  calculations 
by  Inputting  his  judged  Importance  of  data.  Estimating  value  of  Infor- 
mation or  assessing  worth  is  a complex  process.^  One  practical  approach 
Is  to  provide  tables  of  "standard"  relationships  among  possible  data 
elements  so  that  the  computer  could  calculate  and  display  reasonable 
relationships.  Then,  using  the  video  display,  allow  the  analyst  to  move 
the  calculated  center(s)  to  take  into  account  any  special  weighting 
factors.  This  approach  takes  advantage  of  complex  human  judgments  while 
allowing  the  computer  to  assist  in  the  numerous  basic  calculations. 

CONCLUSIONS 

The  analysts  who  organized  graphic  displays  of  battlefield  activity 
Into  patterns  with  the  aid  of  computerized  calculations  were  more 
accurate  than  analysts  who  used  only  graphic  displays. 

The  successful  laboratory  results  suggest  that  the  use  of  com- 
puterized algorithms  linked  with  graphic  displays  of  battlefield  activity 
can  enhance  performance  in  pattern  analysis  tasks.  Such  algorithms  for 
data  manipulation  appear  to  provide  substantially  better  analyses  than 
are  possible  with  processes  using  computerized  graphics  alone.  By 
inference,  the  computerized  techniques  would  also  provide  a speed  and 
accuracy  advantage  over  manual  techniques  involving  grease  pencil 
drawings  of  sightings.  Of  course,  care  should  be  taken  In  generalizing 
from  somewhat  artificial  laboratory  conditions  to  field  applications. 

Nevertheless,  serious  consideration  should  be  given  to  further  develop- 
ment of  aids  for  utilizing  graphic  displays  in  mass/movement  and  related 
temporal/spatial  analyses  of  enemy  forces.  Pending  outcomes  of  these 
additional  developmental  efforts,  the  present  results  appear  sufficiently 
promising  that  some  provision  should  be  made  in  requirements  documents 
for  accommodating  such  aids.  The  likely  benefit  from  the  aids  would  be 
more  accurate  and  consistent  analyses  than  are  currently  possible  from 
data  concerning  enemy  concentrations,  movements,  and  destinations. 


* Johnson,  E.  M.  and  Huber,  G.  The  technology  of  utility  assessment. 
IEEE  Transactions  on  Systems.  Man  and  Cybernetics.  1977.  SMC-7 
(No.  5),  311-325. 
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APPENDIX  A,  QUESTIONS  USED  IN  RESEARCH 

*1.  For  all  the  hours  between  250401  and  251600  (251401  + 2),  In  what 
predominant  direction  were  enemy  wheeled  vehicles  moving?  (N; 

NE;  E;  SE;  S;  SW;  W;  NW)  Don't  forget  use  the  answer  format 

/ "ENTER",  Then  you  answer,  and  then  "ENTER"  !!! 

*2.  Between  the  hours  of  250401  and  251800,  what  is  your  estimate  for 
the  number  of  kilometers  traveled  by  the  lead  armor  elements? 

(Please  use  the  Intercom  for  any  questions  about  the  task  1!) 

*3.  What  Is  the  armor  rate  of  march  (In  km/hr)  between  251401  + 2 
and  251601  2 hours? 

*4.  For  forward  wheeled  reconnaissance  activity  at  251601  + 2 vs. 

252001  + 2,  how  large  Is  the  change  In  emphasis  (In  kilometers)? 
Secondly,  what  is  a single  six-digit  coordinate  Indicating  the 
vicinity  of  this  change?  Format:  km/location  (note:  slash 
always  separates  parts  of  single  answer!) 

5.  What  Is  the  distance  between  the  principle  center  of  mass  for 
armor  sightings  at  251801  + 2 and  the  principle  center  of  mass 
for  armor  sightings  at  252201  + 2? 

+6.  Assuming  that  the  logistical  vehicle  movement  toward  the  NE  has 
been  regular  between  the  hours  of  252201  + 2 and  26001  + 2:  How 
fast  are  these  vehicles  moving  on  the  average  In  kilometers  per 
hour?  (Notebook  of  sighting  reports  Important  to  solution!) 

+7.  How  many  kilometers  separate  artillery  sightings  at  252001  + 2 vs. 
26001  + 2 hours?  (Remember  your  notebook  of  sighting  reports  for 
this  as  well  as  various  future  questions!) 

8.  How  many  kilometers  separate  the  wheeled  vehicle  sightings  at 
252201  + 2 vs  260401  + 2 hours? 

9.  How  much  and  In  what  direction  has  aggressor  center  of  mass  changed 
for  all  wheeled  vehicles  (sighting  for  vehicles  and  brldg.  equip.) 

In  comparing  260001  + 2 with  260601  + 2 hours?  Answer  In  kilometers/ 
direction. 

10.  How  many  kilometers  separate  the  two  centers  of  mass  for  all 
artillery  sightings  — north  of  the  30th  latitude  line  — at  260001 
+ 4 vs.  260601  + 4 hours? 

11.  What  is  the  exact  armor  geographical  center  of  mass  for  all  such 

sightings  at  260001  + 2 as  well  as  the  center  of  mass  for  all  such 
sightings  at  261001  + 2 hours?  Enter  both  answers  as  six  digit 
coordinates  In  the  format:  / . 


*Practlce  question 
4-El  Imlna  ted 


12.  What  is  the  rate  of  march  (In  kilometers  per  hour)  at  which  the 
enemy  has  moved  the  center  of  mass  of  his  artillery  from  252201 
+ 2 (vie  470295)  to  260001  + 2? 

13.  Only  consider  the  artillery  sightings  reported  as  having  no 
direction  of  movement  at  260601  + 2 vs  261401  + 2.  For  purposes 
of  determining  change  In  area  of  battlefield  emphasis,  what  is 
the  distance  and  apparent  direction  of  shift  in  emphasis  for  these 
sightings?  answer:  km/dlrection. 

14.  What  are  the  two  *exact*  wheeled  reconnaissance  activity  centers 

of  mass  for  261001  + 2 (vie  5528)  and  261601  + 2?  Enter  both 
answers  as  six  digit  coordinates  in  the  format:  / . 

15.  G2  seeks  fixed  logistical  targets.  How  far  and  in  what  direction 
has  the  *exact*  geographical  center  moved  for  all  wheeled  vehicle 
sightings  north  of  30th  latitude  line,  at  251801  + 12  vs.  260601 
+ 2 hours?  (Exclude  canal  recon.  sightings!!)  - Answer  in 
kilometers /direct ion. 

16.  How  far  and  in  what  direction  has  the  **artillery**  center  of  mass 
moved  — for  all  sightings  north  of  the  30th  latitude  line  — 
between  251601  + 12  and  260801  + 12  hours?  (Remember  to  give 
your  answer  in  kilometers/direction.) 

17.  How  far  and  in  what  direction  has  the  **armor**  center  of  mass 
moved  for  all  such  sightings  between  261001  + 6 and  261601  + 6 
hours?  (Remember  to  give  answer  in  kilometers/direction.) 

18.  What  is  the  average  rate  and  direction  of  armor  advance  in 
aggressor's  south  sector  between  262001  + 2 and  262201  + 2? 

(Give  your  answer  in  kilometers  per  hour/direction. ) 

19.  What  is  the  average  rate  of  march  and  direction  of  logistical 
activity  in  aggressor's  southern  sector  at  262201  + 2 vs.  270201 
+ 2 hours?  Give  answer  in  kilometers  per  hour /direction. 

20.  G2  is  trying  to  determine  the  enemy  shift  in  artillery  center  of 
mass.  What  is  the  distance  and  direction  of  center  of  mass  shift 
for  252001  + 6 vs.  262001  + 6?  Answer  format  is:  kilometers/ 
direction. 
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APPENDIX  B.  EXAMPLES  OF  DETAILS  OF  SCENARIO  SIGHTINGS  PROVIDED  TO  PARTICIPANTS 

(Page  1 of  3) 


MRT  represents  Motorized  Rifle  Transporters 
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APPENDIX  C.  PATTERN  ANALYSIS  POST-EXERCISE  QUESTIONNAIRE  (Page  1 of  6) 


Your  responses  to  the  following  questions  will  aid  us  in  evaluating 
the  approach  to  information  analysis  that  you  have  been  working  with 
today. 


1.  Do  you  feel  that  your  background  and  experience  was  appropriate  for 

the  role  you  were  asked  to  assume  in  today's  exercise?  Yes No 

Comments : 


2.  Today's  exercise  ran  for  a number  of  hours  during  which  you  were 
required  to  undertake  a series  of  rather  tedious  tasks.  Do  you  feel 
that  your  performance  was  adversely  Influenced  by  the  factor  of  fatigue 
and  that  the  time  is  too  long  to  expect  a user  to  operate  with  our 
system?  Yes ^No Comments: 


3.  Do  you  have  any  suggestions  for  improving  the  instructions.  Please 
comment : 


4.  Did  you  have  sufficient  time  to  learn  to  operate  the  keyboard  and 
generally  become  familiar  with  the  contents  and  configuration  of  the 
data  base?  Yes  No  Comments: 


5.  Did  you  have  any  "mechanical"  problems  with  the  task  that  seriously 
hampered  your  ability  to  obtain  and  manipulate  the  information?  (for 
example,  getting  information,  using  the  keyboard,  etc).  Yes ^No 


Comments : 


6.  Did  you  have  a problem  adapting  to  the  color  code?  Yes ^No 

Comments : 


7.  Were  "prompts"  and  "reminders"  for  operating  the  system  adequate? 
Yes  No  Comments : 


8.  Would  a supplementary  list  of  instructions  have  been  more  helpful 
than  the  summary  confirmation  made  available?  Yes No Comments: 


10.  To  what  extent  were  the  questions  typical  of  what  you  believe 
pattern  analysis  should  do? 


11.  To  what  extent  were  the  "multiple  analyses"  at  the  end  of  the  task 
more  or  less  realistic  than  the  earlier  single  analyses? 


12.  Can  you  suggest  any  additional  pattern  analysis  tasks  which  could  or 
should  be  incorporated  into  this  type  of  exercise? 


13.  Please  comment  on  any  tasks  you  were  asked  to  perform  during  today's 
exercise  which  you  feel  could  have  been  better  performed  if  more 
information  was  available  in  your  data  base? 


14.  Please  comment  on  any  information  concerning  the  enemy  vdiich  you 
would  have  liked  but  were  unable  to  obtain  during  today's  exercise? 


15.  To  what  extent  were  the  data  typical  of  what  you  believe  would  be 
seen  In  a TOC  before  such  an  offensive.  Please  give  specific  examples 


16.  Can  you  suggest  more  useful  ways  of  organizing  the  sighting  data 
than  one  we  used?  Yes ^No . Would  you  explain  a "yes"  answer,  please: 


Number  of  years  experience  related  to  pattern  analysis. 
Evaluation  Condition. 


Please  do  not  discuss  details  of  your  participation  In  today's  evaluation 
with  others  who  may  work  with  us  at  a later  date. 
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GRAID  CONDITION 


Did  the  computerized  aid  for  pattern  analysis  performance  help  you 
to  do  the  Job?  Make  It  easier?  and  so  on. 

a.  What  advantages /disadvantages  does  It  have  compared  to  manual 
methods? 

b.  What  Improvements /changes  would  you  suggest  for  the  aid? 


Additional  Comments 


Use  the  space  provided  below  to  elaborate  on  responses  to  previous 
questions  and/or  to  make  any  additional  comments  relating  to  today's 
exercise. 


DISTRIBUTION 


AR(  Oistribution  List 


4 

2 

2 

2 

2 

2 


OASO(M&RA) 

HQOA  (DAMI  CSZ) 

HQOA  (DAPE  PBR 
HQDA  (DAMA  AR) 

HQOA  (DAPE  HRE  POI 
HQOA  ISGRO  ID) 

HQOA  (OAMI  OOT  C) 

HQOA  (OAPC  PMZ  A) 

HQOA  (DACH  PPZ  A) 

HQDA  (OAPE-HRE) 

HQDA  (DAPE  MPO-C) 

HQDA  (OAPE-OW) 

HQOA  (DAPE-HRL» 

HQOA  (DAPE-CPS) 

HQOA  (DAFD-MFA) 

HQDA  (DARD-ARS-P) 

HQOA  (DAPC-PAS-A) 

HQOA  (OUSA-ORI 
HQOA  (DAMO-RQR) 

HQOA  (DASG) 

HQOA  (DA10-PI) 

Chief,  Consult  Oiv  (DA  OTSG),  Adelphi,  MO 

Mil  Asst.  Hum  Res,  OODR&E,  OAD  (E&LS) 

HQUSARAL.APO  Seattle,  ATTN:  ARAGP-R 

HQ  First  Army,  ATTN:  AFKA-OI-TI 

HQ  Fifth  Army,  Ft  Sam  Houston 

Dir,  Army  Stf  Studies  Ofc,  ATTN:  OAVCSA  (DSP| 

Ofc  Chief  of  Stf.  Studies  Ofc 

DCSPER.  ATTN:  CPS/OCP 

The  Army  Lib,  Pentagon,  ATTN;  RSB  Chief 

The  Army  Lib,  Pentagon.  ATTN;  ANRAL 

Ofc.  Asst  Sect  of  the  Army  (R&O) 

Tech  Support  Ofc.  OJCS 

USASA,  Arlington,  ATTN:  lARD-T 

USA  Rsch  Ofc,  Durham.  ATTN:  Life  Sciences  Dir 

USARIEM,  Natick,  ATTN:  SGRO-UE-CA 

USATTC,  Ft  Clayton,  ATTN:  STETC-MO-A 

USAIMA,  Ft  Bragg,  ATTN:  ATSU  CTD-OM 

USAIMA,  Ft  Bragg,  ATTN:  Marquat  Lib 

US  WAC  Ctr  & Sch.  Ft  McClellan,  ATTN:  Lib 

US  WAC  Ctr  & Sch,  Ft  McClellan,  ATTN:  Tng  Dir 

USA  Quartermaster  Sch,  Ft  Lee,  ATTN:  ATSM-TE 


Intelligence  Material  Dev  Ofc,  EWL,  Ft  Holabird 

USASESignalSch,  Ft  Gordon,  ATTN:  ATSO-EA 

USA  Chaplain  Ctr  & Sch,  Ft  Hamilton,  ATTN:  ATSC-TE-RO 

USATSCH,  Ft  Eustis,  ATTN:  Educ  Advisor 

USA  War  College,  Carlisle  Barracks,  ATTN:  Lib 

WRAIR,  Neuropsychiatry  Oiv 

DLI,  SOA,  Monterey 

USA  Concept  Anal  Agcy,  Bethesda,  ATTN:  MOCA-WGC 
USA  Concept  Anal  Agcy,  Bethesda,  ATTN:  MOCA-MR 
USA  Concept  Anal  Agcy,  Bethesda,  ATTN:  MOCA-JF 
USA  Artie  Test  Ctr,  APO  Seattle,  ATTN:  STEAC-MO-ASL 
USA  Artie  Test  Ctr,  APO  Seattle,  ATTN:  AMSTE-PL  TS 
USA  Armament  Cmd,  Redstone  Arsenal,  ATTN;  ATSK-TEM 
USA  Armament  Cmd,  Rock  IstarKi,  ATTN;  AMSAR-TDC 
FAA  NAFEC,  Atlantic  City,  ATTN:  Library 
FAA-NAFEC,  Atlantic  City,  ATTN;  Hum  Er>gr  Br 
FAA  Aeronautical  Ctr,  Oklahoma  City,  ATTN;  AAC-440 
USA  Fid  Arty  Sch,  Ft  Sill,  ATTN;  Library 
USA  Armor  Sch.  Ft  Knox,  ATTN:  Library 
USA  Armor  Sch,  Ft  Knox,  ATTN:  ATSB-DI-E 
USA/KrmorSch.  Ft  Knox.  ATTN;  ATSB  OT-TP 
USA  Armor  Sch.  Ft  Knox,  ATTN;  ATSB  CO  AD 


2 HQUSACDEC.  Ft  Ord,  ATTN:  Library 

1 HQUSACDEC,  Ft  Ord,  ATTN:  ATEC-EX-E-Hum  Factors 

2 USAEEC.  Ft  Benjamin  Harrison.  ATTN;  Library 

1 USAPACOC,  Ft  Benjamin  Harrison,  ATTN:  ATCP-HR 
I USA  Comm-Elect  Sch,  Ft  Monmouth.  ATTN;  ATSN~EA 
1 USAEC,  Ft  Monmouth,  ATTN:  AMSEL-CT-HDP 
1 USAEC,  Ft  Monmouth,  ATTN;  AMSEL-PA-P 
1 USAEC,  Ft  Monmouth,  ATTN:  AMSEL-SI-CB 
t USAEC,  Ft  Monmouth,  ATTN:  C,  Fact  Dev  Br 
1 USA  Materials  Sys  Anal  Agcy,  Aberdeen,  ATTN:  AMXSY-P 
1 Edgewood  Arsenal,  Aberdeen,  ATTN:  SAREA-BL-H 

1 USA  Ord  Ctr  & Sch,  Aberdeen,  ATTN;  ATSL-TEM-C 

2 USA  Hum  Er>gr  Lab,  Aberdeen,  ATTN:  Library/Oir 

1 USA  Combat  Arms  Tng  Bd,  Ft  Bennirsg,  ATTN;  Ad  Supervisor 
1 USA  Infantry  Hum  Rsch  Unit,  Ft  Banning.  ATTN:  Chief 
t USA  Infantry  Bd.  Ft  Benning,  ATTN:  STE8C-TE-T 
1 USASMA,  Ft  Bliss,  ATTN;  ATSS-LRC 
1 USA  Air  Def  Sch,  Ft  Bliss.  ATTN:  ATSA  CTD  - ME 
1 USA  Air  Def  Sch,  Ft  Bliss,  ATTN;  Tech  Lib 
1 USA  Air  Def  Bd,  Ft  Bliss.  ATTN:  FILES 
1 USA  Air  Def  Bd.  Ft  Bliss,  ATTN;  STEBD-PO 
1 USA  Cmd  & General  Stf  College.  Ft  Leavenworth,  ATTN:  Lib 
t USA  Cmd  & General  Stf  College,  Ft  Leavenworth,  ATTN;  ATSW— SE-L 
1 USA  Cmd  & General  Stf  College.  Ft  Leavenworth,  ATTN:  Ed  Advisor 
1 USA  Combined  Arms  Cmbt  Dev  Act.  Ft  Leavenworth,  ATTN;  OepCdr 
1 USA  Combined  Arms  Cmbt  Dev  Act,  Ft  Leavenworth.  ATTN:  CCS 
1 USA  Combined  Arms  Cmbt  Dev  Act,  Ft  Leavenworth.  ATTN:  ATCASA 
1 USA  Combined  Arms  Cmbt  Dev  Act,  Ft  Leavenworth,  ATTN;  ATCACO-E 
1 USA  Combined  Arms  Cmbt  Dev  Act.  Ft  Leavenworth,  ATTN:  ATCACC— Cl 
1 USAECOM.  Night  Vision  Lab,  Ft  Belvoir,  ATTN;  AMSEL-NV-SD 

3 USA  Computer  Sys  Cmd,  Ft  Belvoir,  ATTN:  Tech  Library 
1 USAMERDC,  Ft  Belvoir,  ATTN:  STSFB-OQ 

1 USA  Eng  Sch.  Ft  Belvoir,  ATTN:  Library 
1 USA  Topographic  Lab,  Ft  Belvoir,  ATTN:  ETL-TO-S 
1 USA  Topographic  Lab.  Ft  Belvoir,  ATTN:  STINFO  Center 
1 USA  Topographic  Lab,  Ft  Belvoir,  ATTN:  ETL-GSL 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN;  CTO-MS 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN;  ATS-CTO-MS 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  ATSI-TE 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  ATSI— TEX— GS 
t USA  Intelligence  Ctr  & Sch.  Ft  Huachuca,  ATTN;  ATSI-CTS-OR 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  ATSI— CTD-OT 
1 USA  Intelligence  Ctr  8>  Sch,  Ft  Huachuca,  ATTN:  ATSI-CTD-CS 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN;  DAS/SRD 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  ATSI-TEM 
1 USA  Intelligence  Ctr  & Sch,  Ft  Huachuca,  ATTN:  Library 

1 COR,  HQ  Ft  Huachuca,  ATTN:  Tech  Ref  Oiv 

2 CDR,  USA  Electronic  Prvg  Grd,  ATTN:  STEEP-MT-S 
1 CDR,  Project  MASSTER,  ATTN:  Tech  Info  Center 

1 Hq  MASSTER.  USATRADOC.LNO 
1 Research  Institute,  HQ  MASSTER,  Ft  Hood 
1 USA  Recruiting  Cmd.  Ft  Sherdian,  ATTN:  USARCPM-P 
1 Senior  Army  Adv.,  USAFAGOD/T AC.  Elgin  AF  Aux  Fid  No.  9 
1 HQUSARPAC,  DCSPER,  APO  SF  96568.  ATTN:  GPPE-SE 
1 Stinnon  Lib,  Academy  of  Health  Sciences,  Ft  Sem  Houston 
1 Marine  Corps  Inst.,  ATTN:  Dean-MCI 
1 HQUSMC,  Commandent,  ATTN;  Code  MTMT  51 

1 HQUSMC,  Commandent,  ATTN;  Code  MPt -20 

2 USCG  Academy,  New  LocKton,  ATTN:  Admission 
2 USCG  Academy,  New  London.  ATTN;  Library 

1 USCG  Training  Ctr.  NY.  ATTN;  CO 
1 USCG  Training  Ctr,  NY,  ATTN:  Educ  Sve  Ofc 
1 USCG,  Psychol  Res  Br,  DC.  ATTN;  GP  1/62 
1 HQ  Mid-Range  Br,  MC  Dtt,  Quentico,  ATTN;  PBS  Div 


1  Def  & Civil  Inst  of  Enviro  Medicine,  Canada 
1 AIR  CRESS,  Kensington.  ATTN:  Info  Sys  Bf 
1 Militaerpsykologisk  Tieneste,  Copehagen 
1 Militery  Attache.  French  En>bassv,  ATTN;  Doc  Sec 
1 Medecin  Chef.  C.E.R.P. A. —Arsenal.  Toulon/Naval  France 
1 Prin  Scientific  Off,  AppI  Hum  Er>gr  Rsch  Oiv,  Ministry 
of  Defense,  Nevi^  Delhi 

1  Pers  Rsch  Ofc  Library,  AKA,  Israel  Defense  Forces 
1 Ministeris  van  Defensie,  DOOP/KL  Afd  Sociaal 
Psychologische  Zaken,  The  Hague,  Netherlands 

1 USA  Air  Def  Sch,  Ft  Bliss,  ATTN:  ATSA  TEM 
1 USA  Air  Mobility  Rsch  & Dev  Lab,  Moffett  Fid,  ATTN:  SAVDL— AS 
1 USA  Aviation  Sch,  Res  Tng  Mgt,  Ft  Rucker,  ATTN:  ATST-T-RTM 
1 USA  Aviation  Sch,  CO,  Ft  Rucker,  ATTN:  ATST-D-A 
1 HQ.  USAMC,  Alexandria,  ATTN:  AMXCD-TL 
1 HQ,  USAMC,  Alexandria.  ATTN:  CDR 
1 US  Military  Academy,  West  Point.  ATTN:  Serials  Unit 
1 US  Military  Academy,  West  Point,  ATTN:  Ofc  of  Milt  Ldrshp 
1 US  Military  Academy,  West  Point,  ATTN:  MAOR 
1 USA  Standardization  Gp.  UK.  FPO  NY,  ATTN:  MASE-GC 
1 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  452 
3 Ofc  of  Naval  Rsch.  Arlington,  ATTN:  Code  458 
1 Ofc  of  Naval  Rsch,  Arlington,  ATTN:  Code  450 
1 Ofc  of  Naval  Rsch.  Arlington.  ATTN;  Code  441 
1 Naval  Aerospc  Med  Res  Lab,  Pensacola,  ATTN:  Acous  Sch  Div 
f Naval  Aerospc  Med  Res  Lab,  Pensacola.  ATTN;  Code  LSI 
1 Naval  Aerospc  Med  Res  Lab,  Pensacola,  ATTN:  Code  L5 
1 Chief  of  NavPers,  ATTN;  Pers-OR 
1 NAVAIRSTA,  Norfolk.  ATTN:  Safety  Ctr 
1 Nav  Oceanographic,  DC.  ATTN:  Code  6251.  Charts  & Tech 
1 Center  of  Naval  Anal,  ATTN:  Doc  Ctr 
1 NavAirSysCom.  ATTN:  AIR-531X 
1 Nav  BuMed,  ATTN:  713 
1 NavHelicopterSubSqua  2.  FPO  SF  96601 
1 AFHRL  (FT!  William  AFB 
1 AFHRL(TT)  Lowry  AFB 

1 AFHRLIASIWPAFB.OH 

2 AFHRL  (DOJZ)  Brooks  AFB 

1 AFHRL  IDOJN)  Lackland  AFB 
1 HQUSAF  (INYSD) 

1 HQUSAF (DPXXA) 

1 AFVTG  (RO)  Randolph  AFB 

3 AMRL(HE)WPAFB.OH 

2 AF  Inst  of  Tech,  WPAFB.  OH,  ATTN:  ENE/SL 
1 ATC  (XPTD)  Randolph  AFB 

1 USAF  AeroMed  Lib,  Brooks  AFB  (SUL-4).  ATTN:  DOC  SEC 
1 AFOSR  (NL).  Arlington 

1 AF  Log  Cmd,  McClellan  AFB,  ATTN:  ALC/DPCRB 

1 Air  Force  Academy,  CO,  ATTN:  Dept  of  Bel  Sen 
5 NavPers  & Dev  Ctr,  San  Diego 

2 Navy  Med  Neuropsychiatric  Rsch  Unit,  San  Diego 
1 Nav  Electronic  Lab,  San  Diego,  ATTN:  Res  Lab 

1 Nav  TrngCen,  San  Diego,  ATTN:  Code  9000-Lib 
1 NavPostGraSch.  Monterey,  ATTN:  Code  55Aa 
1 NavPostGraSch,  Monterey,  ATTN;  Code  2124 
1 NavTrngEquipCtr,  Orlando.  ATTN:  Tech  Lib 
1 US  Dept  of  Labor.  DC,  ATTN;  Manpower  Admin 
1 US  Dept  of  Justice,  DC,  ATTN:  Drug  Enforce  Admin 
1 Nat  Bur  of  Standards,  DC.  ATTN:  Computer  Info  Section 
1 Nat  Clearing  House  for  MH— Info,  Rockville 
1 Denver  Federal  Ctr.  Lakewood,  ATTN:  BLM 
1 2 Defense  Documentation  Center 

4 Dir  Psych,  Army  Hq,  Russell  Ofes,  Canberra 

1 Scientific  Advsr,  Mil  6d.  Army  Hq.  Russell  Ofes,  Canberra 
1 Mil  and  Air  Attache,  Austrian  Embassy 

1 Centre  de  Recherche  Des  Factaurs,  Humaine  de  la  Defense 
Nationals,  Brussels 

2 Canadian  Joint  Staff  Washir>gton 

1 C/Air  Staff,  Royal  Canadian  AF,  ATTN:  Pars  Std  Anal  Br 

3 Chief,  Canadian  Def  Rich  Staff.  ATTN;  C/CRDS(W) 

4 British  Def  Staff,  British  Embassy,  Washington 


1 US  Marine  Corps  Liaision  Ofc,  AMC,  Alexandria,  ATTN;  AMCGS— F 
1 USATRADOC.  Ft  Monroe,  ATTN;  ATRO-EO 
6 USATRADOC,  Ft  Monroe.  ATTN;  ATPR-AD 
1 USATRADOC,  Ft  Monroe,  ATTN:  ATTS-EA 

1 USA  Forces  Cmd,  Ft  McPherson,  ATTN:  Library 

2 USA  Avtatlon  Test  Bd,  Ft  Rucker,  ATTN;  STEBG-PO 

1 USA  Agcy  for  Aviation  Safety.  Ft  Rucker,  ATTN:  Library 
1 USA  Agcy  for  Aviation  Safety,  Ft  Rucker.  ATTN;  Educ  Advisor 
1 USA  Aviation  Sch,  Ft  Rucker,  ATTN;  PO  Drawer  0 

1 HQUSA  Aviation  Sys  Cmd,  St  Louis,  ATTN:  AMSAV— ZDR 

2 USA  Aviation  Sys  Test  Act.,  Edwards  AFB.  ATTN;  SAVTE-T 


